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(54) Contents reproduction apparatus and method thereof 



(57) A contents reproduction apparatus which re- 
produces contents suitable for a user's environment is 
provided. The contents reproduction apparatus includes 
a position detecting unit detecting a user's position, an 



operation detecting unit detecting a movement of a us- 
er's body, a contents generating unit generating con- 
tents based on the user's position and the movement of 
the user's body, and a contents reproducing unit repro- 
ducing the generated contents. 
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Description 

[0001] The present invention contains subject matter 
relatedto Japanese Patent Application JP 2004-111445 
filed in the Japanese Patent Office on April 5, 2004, the 
entire contents of which being incorporated herein by 
reference. 

[0002] The present invention relates to a contents re- 
production apparatus and a method for reproducing 
contents. 

[0003] A portable music reproducer has come into 
wide use, with use of such a portable music reproduce, 
a user can enjoy a music while moving, for example, 
when the user is in transit by train, moving, moving on 
foot, or jogging around. There exists a portable music 
reproducer which reproduces music contents stored in 
a recording medium, such as an MD (mini-disc; Regis- 
tered Trademark), a CD (Compact Disc), etc.. or incor- 
porates an HD (Hard Disc) storing music contents, a 
semiconductor memory and the like. 
[0004] Incidentally, a reproducing environment of a 
music of a portable type music reproducer changes in 
accordance with a place and time in which the user 
moves. In addition, a user's mood always changes. The 
music suitable for the user also changes in response to 
this. 

[0005] As described above, the music reproducer re- 
produces the music contents recorded in a recording 
medium or a recorder intact. However when already re- 
corded music contents are merely continuously repro- 
duced in a recorded order, the musto suitable for a place 
and time in which the user exists, and the user's mood 
cannot be reproduced. Therefore, In order that the user 
may obtain a sense of unity with the music, there exists 
a music reproducer in which a user's walking pace, 
(walking pace/running pace simply called "pace" is de- 
tected, and the user's walking pace is synchronized with 
a tempo (rate of speed of the beat of music) of the music 
reproduced (refer to, for example, Jpn. Pat. Appln. Laid- 
Open Publication No. 2003-85888). 
[0006] Nevertheless, by merely synchronizing the 
tempo of the music reproduced with the user's walking 
pace does not provide the music suitable for a user's 
environment, such as a place and time where the user 
exists. This applies to not only the music contents but 
also videos and other kind of Infomriation. 
[0007] The present invention has been made in view 
of the above-mentioned subject, and it is desirable to 
provide contents reproduction apparatus and a method 
thereof which reproduces contents suitable for a user's 
environment. 

[0008] In order to achieve the above-mentioned ob- 
ject, a contents reproduction apparatus according to the 
present invention detects a user's position in a position 
detecting means, and detects a movement of a user 
body in an operation detecting means. A contents gen- 
erating means generates contents suitable for the user 
based on the user's position and the user's movement. 



The generated contents are reproduced for the user by 
contents reproducing means. 

[0009] Further, in a method for reproducing contents 
according to the present Invention, a position detecting 

5 step detects the user's position, and an operation de- 
tecting step detects the movement of the user's body. A 
contents generating step generates the contents suita- 
ble for the user based on the user's position and the 
movement of the user's body, and a contents reproduc- 

10 ing step reproduces the generated contents for the user. 
[0010] According to the present invention, since the 
contents are generated based on the user's position and 
the movement of the user's body, when the user moves, 
such as he or she goes for a walking, jogging, etc., the 

15 contents change in response to a user's walking speed 
and circumferential environment, and the contents suit- 
able for the user can be reproduced. Further, since the 
contents are changed in response to the user's move- 
ment and operation, the user feels a sense of unity with 

20 the contents, thereby improving entertainment proper- 
ties. 

[001 1] These objects and other objects, features and 
advantages of the present invention will become more 
apparent from the following detailed description of the 
25 preferred embodiments of the present invention when 
taken In conjunction with accompanying drawings. 
[001 2] The Invention will now be described by way of 
examples with reference to the accompanying draw- 
ings, In which: 

30 

FIG. 1 is a block diagram showing a constitution of 
a contents reproducer; 

FIG. 2 Is a block diagram showing a software con- 
figuration of the contents reproducer; 
35 FIG. 3 is a view showing mounting positions of an 
acceleration sensor and a GPS unit; 
FIG. 4 is a view showing an output example of the 
acceleration sensor; 

FIG. 5 is a view showing a constitution and a mount- 
40 ing position of a general purpose foil strain gage; 

FIGS. 6A and 6B are views each showing an output 

example of the general purpose foil strain gage; 

FIG. 7 is a flowchart showing an operation of the 

contents reproducer; and 
45 FIG. 8 is a view showing a user's moving route. 

[0013] The present Invention is applied to a portable 
contents reproduction apparatus, such as music repro- 
ducer, a video reproducer, a portable telephone, a PDA, 

50 a laptop computer, a wearable computer. The present 
invention has features to generate contents reproduced 
for a user who moves around while carrying the contents 
reproduction apparatus in response to the movement of 
the user and a user's position, or to change the contents 

55 reproduced for the user. 

[0014] Referring to FIG. 1, the present Invention will 
be described with respect to an example applied to a 
contents reproducer 1 . The contents reproducer 1 is an 
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apparatus for reproducing voice contents and video 
contents. The contents reproducer 1 includes a voice 
output unit 10 for outputting a voice, and a display unit 
11 for outputting an image. The voice contents and the 
video contents are stored in a storage 1 2. As the storage 
12, there are an HD (Hard Disc), an optical disc, a sem- 
iconductor memory, etc. The voice contents and the vid- 
eo contents can be downloaded through a network con- 
nector 13 via the Internet. 

[0015] The contents reproducer 1 Includes a key input 
unit 14, and a microphone 15. The key input unit 14 ac- 
cepts inputting of a command, such as "reproducing", 
"stop", " temporary stop", "selection of music", etc. A ra- 
dio interface 1 6 performs a radio communication with a 
walking sensor 2 and a GPS unit 3 to be described later, 
and receives walking data and position data. 
[0016] A CPU (Central Processing Unit) 17 controls 
the contents reproducer 1 . A program and setting infor- 
mation necessary to control the contents reproducer 1 
are stored in a ROM (Read Only Memory) 1 8 and the 
storage 12. The CPU 17 forms and processes the con- 
tents in accordance with an analysis of user's walking 
operation, an analysis of user's environment and the 
contents in response to the user's environment, as a 
RAM (Random Access Memory) 19 for work area. 
[0017] FIG. 2 shows a software configuration of the 
contents reproducer 1 . The contents reproducer 1 in- 
cludes a walking analy2er20 for analyzing a user's walk- 
ing operation based on an output of the walking sensor 
2, a position specifying unit 21 for specifying the place 
where the user exists based on the output of the GPS 
unit 3 and map data, a schedule input unit 22 for receiv- 
ing the input of the user's schedule, an environment an- 
alyzer 23 for analyzing the user's environment based on 
the user's walking operation, the user's position and the 
user's schedule, and a reproduction contents generator 
24 for generating the contents in response to the user's 
environment and processing the contents in response 
to the user's environment. 

[0018] The walking analyzer 20 analyzes the user's 
walking operation based on walking data outputted from 
the walking sensor 2. As a specific example of the walk- 
ing sensor 2, there are an acceleration sensor 4 for de- 
tecting the user's vertical movement and a general-pur- 
pose foil strain gage 5 for detecting the user's foot step. 
[0019] The acceleration sensor 4 is mounted at a 
headphone 40 of the contents reproducer 1 . The head- 
phone 40 is one of the voice output unit 10 shown in 
FIG. 1 . FIG. 3 shows a mounting example of the accel- 
eration sensor 4. In a head top headphone 40a of the 
headphone of the type in which a connector 43 for con- 
necting left and right speakers 41 and 42 is wrapped on 
a head top part of the user, the acceleration sensor 4 is 
mounted at a center of the connector 43, that is, the up- 
per part of the user's head top part. In a neck band type 
headphone 40b of the headphone of the type in which 
a connector 46 for connecting left and right speakers 44 
and 45 is wrapped on a rear head part of the user, the 



acceleration sensor 4 is mounted at a center of the con- 
nector 46, that is, at the backside of the user's rear head 
part. In an inner ear type headphone 40c of the head- 
phone of the type in which the speakers are inserted into 
s user's ear holes, each acceleration sensor 4 Is mounted 
at left and right speakers 47 and 48. 
[0020] The acceleration sensor 4 detects a vibration 
of a vertical axis. FIG. 4 shows an output example of the 
acceleration sensor 4 during walking. In FIG. 4, time is 
plotted on an abscissa axis, and a value of an acceler- 
ation is plotted on an ordinate axis. In FIG. 4, after the 
start of a measurement "fast and small vibration" is de- 
tected during the time interval from 0 to 6 seconds "slow 
and small vibration" is detected during the time interval 
from 6 to 15 seconds, "fast and strong vibration" is de- 
tected during the time interval from 18 to 22 seconds, 
"slow and large vibration" is detected during the time in- 
terval from 23 to 32 seconds, and "fast and strong vi- 
bration" is detected during the time interval from 32 to 
34 seconds. 

[0021 ] The walking operation analyzer analyzes a us- 
er walking operation based on a period and vibrating 
width of the vibration. For example, "fast and small vi- 
bration" is judged as walking with short and quick steps, 
"slow and small vibration" is judged as walking with big 
and slow steps, "fast and strong shock" is judged as run- 
ning with short steps, "slow and large shock" is judged 
as skip, and "fast and strong shock" Is judged as running 
at full speed. In addition, when the vibration is not de- 
tected, the walking analyzer judges a stationary state. 
[0022] The GPS unit 3 is attached to the headphone 
40. When the GPS unit 3 is attached to the top of the 
head, an Interruption of a radio wave is less frequent 
and an accuracy is improved. Incidentally, this GPS unit 
3 receives, in addition to the radio wave outputted from 
a satellite, a radio wave radiated from a radio commu- 
nication network, a satellite communication network for 
a portable telephone as position information. 
[0023] Incidentally, the mounting positions of the GPS 
unit 3 and the acceleration sensor 4 may be a head- 
mounted display, a wrist watch, a shoe, a clothing, an 
accessory and the like. 

[0024] FIG. 5 shows a general-purpose foil strain 
gage 5 as a specific example of the walking sensor 2. 
The general-purpose foil strain gage 5 converts the 
force in the bending direction into an electric signal. The 
positive or negative of the electric signal corresponds to 
the bending direction. The walking sensor 2 is mounted 
so as to output the positive electric signal when the foot 
is stepped down, and to output the negative electric sig- 
nal when the foot is separated from the ground. The gen- 
eral-purpose foil strain gage 5 is laminated on a phos- 
phor bronze plate 51 . An output temriinal 52 of the gen- 
eral-purpose foil strain gage 5 is reinforced by a rein- 
forcing material 53, and extended outside of the phos- 
phor bronze plate 51 . The output terminal 52 of the gen- 
eral-purpose foil strain gage 5 is connected to an ampli- 
fier 54. The amplifier 54 Is connected to a radio interface 
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55. The radio interface 55 transmits user's walking data 
to the contents reproducer 1 . 

[0025] FIGS. 6A and 6B show an output example of 
the general-purpose foil strain gage 5. In this example, 
an output of the general-purpose foil strain gage 5 when 
a user walks at a normal walking tempo, an output when 
the user walks at a slow walking tempo, and an output 
when the user walks at a fast walking tempo, are dis- 
played The output of the general-purpose foil strain 
gage 5 becomes maximum at a moment that user's foot 
is grounded, and becomes minimum at a moment that 
the user's foot is separated from the ground. The gen- 
eral purpose foil strain gages 5 may be respectively pro- 
vided at left and right feet, or may be provided only at 
one foot, and may be utilized at 1/2 of a grounding in- 
terval as a walking tempo. FIG. 6A shows an output of 
the general-purpose foil strain gage 5 attached to the 
sole of the left foot, and FIG. 6B shows an output of the 
gen era! -purpose foil strain gage 5 attached to the sole 
of the right foot. The user's walking tempo is a time in- 
terval from when the one foot is grounded until the other 
foot is grounded, that is, the time interval from when the 
value of the general purpose foil strain gage 5 of one 
foot becomes maximum to when the value of the general 
purpose foil strain gage 5 of the other foot becomes 
maximum. 

[0026] Incidentally, the walking data can be detected 
by the acceleration sensor attached to an arm or a wrist, 
and a direction indicator attached to a part of the user's 
body. The acceleration sensor attached to the ami or 
the wrist can detect the shock of a hand synchronized 
with stepping down of a foot, and the direction indicator 
can detect the moving direction of the user. 
[0027] The position specifying unit 21 reads, when the 
user's position information is inputted from the GPS unit 
3, map information recorded in the storage 12, com- 
pares the position information with the map information, 
and specifies the place where the user exists. 
[0028] The schedule input unit 22 receives an input of 
the user's schedule. The schedule input unit 22 can in- 
put the schedule of the contents, such as which song 
the user reproduces while what kind of things he or she 
is doing, and which song the user reproduces, while 
what king of mood he or she is in addition to the schedule 
written in an ordinary schedule book, data and hour, 
place, and what kind of things the user is planning to do. 
[0029] The schedule of the music is recorded in as- 
sociation with a place, time, day of the week, mood, and 
so forth. As one example of the music schedule, a jog- 
ging course and the schedule of the song played during 
jogging will be described. In this schedule, the jogging 
course, a place (building, signpost) to be a trigger for 
changing the music, and the songs to be reproduced 
during Jogging can be specified. In this schedule, it is 
set to repeatedly reproduce the same song between a 
certain point and next point. Even if the same song is 
repeatedly reproduced, a melody is changed in accord- 
ance with the user's walking tempo, and hence the user 



never get tired. 

[0030] In addition to the song to be reproduced, the 
contents of which element of the music is changed, can 
be inputted as the schedule. Input items include a tem- 

5 po, melody, musical interval, tone, strength. Thus, the 
user can select a change of only a tempo, a change of 
only a musical interval, a change of only a melody, a 
change of contents and so on. thereby extending the 
degree of freedoms of selecting. 

10 [0031] The inputted schedule is updated through 
learning. If the stop of the reproduced song, change of 
the melody, change of the program of the song repro- 
duced, etc., are instructed by the user, this instruction 
can be used as learning data, and when the music is 

15 reproduced in the same environment, the leaning data 
becomes a judging material in the case of selecting and 
changing the music. 

[0032] The environment analyzer 23 analyzes the us- 
er's circumferential environment and a user's psycho- 

20 logical state from a user's position specified by the po- 
sition specifying unit 21 , the user's schedule inputted to 
the schedule input unit 22, and the user's walking oper- 
ation analyzed by the walking analyzer 20. Forexample, 
a schedule for arranged meeting at an entrance of a de- 

25 partment store at 6 o'clock Is recorded. When It is 5:50 
by the watch, the user locates around the department 
store, and a user's walking operation is trot, the environ- 
ment analyzer 23 judges that the user Is directed urgent- 
ly to a meeting place based on these contents. 

30 [0033] The reproduction contents generator 24 gen- 
erates the contents suitable for the analyzed result of 
the environment analyzer 23 and processes the con- 
tents. As In the above-mentioned example, as a result 
of the analysis, when it is judged that the user is in a 

35 hurry, in order to raise the user's walking pace, the gen- 
erator 24 makes the rhythm of the music faster, or se- 
lects a music having a fast beat. In the case that the 
music contents are MIDI (Muste Instruments Digital In- 
terface), control of the tempo and melody of the music 

40 can be facilitated. Further, the reproduction contents 
generator 24 fomns useful contents, such as a required 
time getting to the arranged meeting place, a present 
time, etc, and reproduces the contents. 
[0034] An operation of the contents reproducer 1 will 

45 be described with reference to the flowchart of FIG. 7. 
The operation of the contents reproducer 1 is started 
from inputting of a user's schedule. The schedule input 
unit 22 records the input from the user in the storage 1 2 
(step S11). The user starts moving by carrying the con- 

50 tents reproducer 1 . The contents reproducer 1 repro- 
duces the music contents and the video contents while 
the user is moving (step S12). 

[0035] The contents reproducer 1 detects the walking 
data by the walking sensor 2 and detects the position 
55 databytheGPS unit 3 (step S 13). The walking analyzer 
20 analyzes the user walking operation based on the 
walking data. The position specifying unit 21 specifies 
the user's position based on the output of the GPS unit 
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3 (step S14). 

[0036] The environment analyzer 23 analyzes the us- 
er psychological state and user's circumferential envi- 
ronment based on the user's walking operation, the us- 
er's location, and the user's schedule, and outputs the ^ 
analyzed result to the reproduction contents generator 
24. The reproduction contents generator 24 reproduces 
to the user by changing the melody or rhythm of the con- 
tents reproduced at present to meet the user's psycho- 
logical state and circumferential environment, or gener- 
ating appropriate information. The contents reproduced 
for the user may be character data or image data. The 
reproduction contents generator 24 may reproduce the 
contents for the user by way of a vibrating function, or 
by flashing and/or lighting an LED (Light-Emitting Diode) 
(step S 15). 

[0037] The contents reproducer 1 transfers to a proc- 
ess in step S1 2 when the user does not designate stop- 
ping of operation (NO in step S 1 6). The contents repro- 
duced by the contents reproducer 1 are dynamically 
changed by this process. Meanwhile, when the user 
designates to stop the operation (YES in step S1 6), the 
contents reproducer 1 completes the process. 
[0038] The above-mentioned operation will further be 
concretely described. In this example, a schedule the 
user stops at a library and a friend's house, and must 
retum home until a certain time, is recorded. The user, 
as shown in FIG. 8, stops at the library, then goes to the 
friend's house. However, there is a park on the way from 
the library to the friend's house, and the user stops by 
the park on the way to the friend's house. The user 
wears an earphone of the contents reproducer 1 in his 
or her ear and listens a music while the user moves 
along the above-mentioned route. 
[0039] First, the operation of the contents reproducer 
1 in a section in which the user starts his or her own 
house, that is a departure spot, and goes toward the li- 
brary will be described. The contents reproducer 1 de- 
tects the pace and direction of the user white the user 
moves to the library. Aflat road continues from the user's 
house to the library, and there is no particulariy out- 
standing building or scenery. Therefore, the user's pace 
is monotonous. The environment analyzer 23 judges 
that the user is a nomrial state. The reproduction con- 
tents generator 24 perfonns normal continuous repro- 
duction without changing the music listening by the user 
in accordance with the judgment of the environment an- 
alyzer 23. When the position specifying unit 21 detects 
that the user arrives at the library, the reproduction con- 
tents generator 24 fades out the volume of the music 
contents. 

[0040] The reproduction contents generator stops re- 
producing of the music contents while the user exists in 
the library. When the position specifying unit 21 detects 
that the user leaves the library, the reproduction con- 
tents generator 24 fades in the volume of the music con- 
tents, and reproduces the music by an original volume. 
Incidentally, when the user carries a book to be retumed 



to the library, a message of prompting the user to return 
the book is displayed on a display unit 11. Contrarily, 
when there is a necessary book, a title of the book, re- 
lated keyword and the like are displayed on the display 
unit 11. Such an alanm message is previously inputted 
to the schedule by the user 

[0041] When the user leaves the library and walks to- 
ward a park, the position specifying unit 21 detects that 
the user starts walking a road along a river, and the walk- 
ing analyzer 20 detects that the user's walking tempo is 
lowered. The environment analyzer 23 judges that the 
user walks slowly with good mood from the detected re- 
sult. The reproduction contents generator 24 slows the 
music tempo to keep pace with the walking tempo ac- 
cording to the analyzed result of the environment ana- 
lyzer 23, and selects the song that matches to the user's 
walking tempo. Contrarily to the above, when the user 
moves the road along the river at a trot, the song having 
a fast tempo is selected to keep pace with the user's 
walking operation, or increases the tempo of the song 
being reproduced. 

[0042] As the user arrives at the park and thus the 
walking operation is stopped, the environment analyzer 
23 judges that the user takes a rest in the part. The re- 
production contents generator 24 reproduces the music 
suitable for a rest in the park., for example, a healing 
music, etc. Further, when the user takes a rest, a video, 
television program, e-mail, weather forecast and the like 
may be displayed on the display unit 11 . 
[0043] The road from the park to the friend's house is 
an easy road surrounded by greenery. When the user's 
walking tempo becomes fast in^espective of such a road, 
the environment analyzer 23 judges that the user makes 
haste. According to the analyzed result, the reproduc- 
tion contents generator 24 reproduces a song for fas- 
tening user's walking pace, an up-tempo song, or accel- 
erates the tempo of the music being reproduced. When 
there is a place where the volume of traffic is heavy in 
the user's moving direction, an alamn of "watch out for 
vehicle", etc. may be displayed on the display unit 11, 
or an alert sound is inserted to the song being repro- 
duced. 

[0044] When the user arrives at the friend's house, the 
reproduction contents generator 24 fades out the music 
being reproduced. The music stops while the user stays 
in the friend's house. The reproduction contents gener- 
ator 24 fades in the stopped music when the user leaves 
the friend's house, and reproduces the music In a state 
before stopping. 

[0045] When the user leaves the friend's house, the 
user finishes the schedule of the day. The environment 
analyzer 23 analyzes that the user completes the sched- 
ule and leaves for home. The reproduction contents 
generator 24 selects and reproduces the music suitable 
for the end of a day finish in accordance with the ana- 
lyzed result of the environment analyzer 23. Further, 
when a returning home time is appointed, the alert 
sound is inserted or the music having a fast tempo is 
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elected so as to be in time for the returning home time. 
[0046] As described above, the contents reproducer 
1 applied with the present invention reproduces the con- 
tents suitable for the user's walking operation and the 
user's position, to the user. The contents change In ac- 
cordance with the user's walking operation and the us- 
er's position. Therefore, the entertainment properties of 
the music reproduced to the user can be improved while 
the user is out, such as, jogging, walking, etc, 
[0047] Since the contents to be reproduced are 
changed in accordance with the user's mood and sched- 
ule, the contents that make the user comfortable or the 
contents that make the user act in accordance with his 
or her schedule can be reproduced. 
[0048] It should be understood by those skilled in the 
art that various modifications, combinations, sub-com- 
binations and alterations may occur depending on de- 
sign requirements and other factors insofar as they are 
within the scope of the appended claims or the equiva- 
lents thereof. 



5. The contents reproduction apparatus according to 
claim 4, wherein the music contents are stored in at 
least one of an optical disc, hard disc, and semicon- 
ductor memory. 

5 

6. The contents reproduction apparatus according to 
any one of claims 1 to 5, wherein the position de- 
tecting means detects a user's position based on a 
radio wave received from at least one of a GPS 

fo (Global Positioning System), radio communication 
network, and satellite communication network for a 
portable telephone. 

7. The contents reproduction apparatus according to 
15 any one of claims 1 to 6, further comprising: 

a schedule input means for receiving an input 
of the user's schedule, wherein the contents 
generating means generates contents based 
20 on the user's position, the movement of the us- 

er's body, and the schedule. 



20 



Claims 



8. A method for reproducing contents, comprising: 



1. A contents reproduction apparatus comprising: 



25 



position detecting means for detecting a user's 
position; 

operation detecting means for detecting a 
movement of a user's body; 30 
contents generating means for generating con- 
tents based on the user's position and the 
movement of the user's body; and 
contents reproducing means for reproducing 
the generated contents. 35 9. 



a position detecting step of detecting a user's 
position; 

an operation detecting step of detecting a 
movement of a user's body; 
a contents generating step of generating con- 
tents based on the user's position and the 
movement of the user's body, and 
a contents reproducing step of reproducing the 
generated contents to the user. 

A contents reproduction apparatus comprising; 



The contents reproduction apparatus according to 
claim 1 , further comprising: 

walking specifying means for specifying a us- 
er's walking operation from the movement of 
the user's body, wherein 
the contents generating means generates con- 
tents based on the user's position and the us- 
er's walking operation. 45 



a position detecting unit detecting a user's po- 
sition; 

an operation detecting unit detecting a move- 
ment of a user's body; 

a contents generating unit generating contents 
based on the user's position and the movement 
of the user's body; and 

a contents reproducing unit reproducing the 
generated contents. 



3. The contents reproduction apparatus according to 
claim 1 or 2, wherein the operation detecting means 
detects at least one of a vertical movement of a us- 
er's body trunk and head, grounding of a user's foot, so 
and a direction of the user. 



4. The contents reproduction apparatus according to 
claim 1 , 2 or 3, wherein the contents generating 
means changes at least one of a tempo, melody, 55 
musical interval, tone, dynamics, and sound vol- 
ume, of music contents. 
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